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ABSTRACT 


The DESEE of this study is to evaluate the accuracy 
of a procedure used to compute an estimate of the lower 
100(1-y)% confidence limit for reliability of a system of 
independent components connected in logical series. The 
procedure takes a Bayesian epproach and uses test data on 
the individual components where the sample sizes may be 
unequal and no knowledge of the component failure distri- 
bution is needed. A computer simulation is used to gener- 
ate test failure data and to compute estimates for the 


lower 100(1-y)% confidence limit on system reliability. 
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BR ENNRODECTEGŃ 


The problem of determining economically a lower 
100(1-y)5% confidence limit on the system reliability of 
complex and expensive systems has plagued reliability 
managers for a long time. In 1968 Joseph Bram of the Cen- 
ter for Naval Analyses developed an approximate procedure 
to attack this problem for systems of independent components 


f m : | 
SORNĘEGTEGFIN"ICEtcalNS PREZ 


πι "ο the purpose ot this 
study to test the accuracy of Bram's procedure and to de- 
termine the limits of its usefulness, especially in appli- 
cations involving systems of ten or more components. The 
accuracy measurements are devermined through a ee 
simulation. 

In an erlort Co demonstrate reliability goals on expen- 
Sive systems, it is usually not economically feasible to 
test the entire system many times. Bram takes a Bayesian 
approach using test data, successes and failures, on indi- 
vidual components or subsystems to obtain an estimate for 
the lower confidence limit on the overall system reliabil- 
ity. The method assumes that the components are indepen- 
dene, and test sample sizes for the various components may 
be unequal. No knowledge or assumptions about the compon- 
ents failure rates 1s needed for the computation, only 


Che test (allure dala. 


center bor Naval Analyses, 0.E.G. Rescareh σι στ ρω το 
No. 795° Confadence Limits for Systemi Κε πατε by σσ ο 


Bram, 2 February 1968. 





II. RELIABILITY MODEL AND COMPUTATION PROCEDURES 


D THE RELIABIETITY MODEL ANDOCOMPUTATION PROCEDURE: 
METHOD A 


1. Summary of the Reliability Model 
Consider k independent components, as in Figure 1, 
connect in logical series with respective individual relia- 
policies Dj» Pos***„Dy' By the product rule for series 


systems, the actual overall system reliability, Ru» 15 


given by n 
R., = IO 
S 15 1 
--- Lx) 
Component reliability : Py Po Ρις 
Number of tests: n4 N, ny 
Number of successes: $1 5, Sk 
ΠΡΙ 


THE SERIES o to Lem MODEL 


In Bram's Bayesian approach to finding an estimate for 
the lower confidence bound on system reliability, the ρ. 5, 
and hence Ro» are considered to be random variables. If the 
distribution from which the p, 5 were sampled were known, 


a lower confidence bound could be calculated without 





testing. Since Chis ο πμ 1s ner Knowmellewever, the 
Bayesian's assume a prior distribution which when combined 
nich the vest ava ΤΕ ου posterior distribution , hope- 
fully one that is recognizable and from which confidence 
limits can easily be computed. 
By considering the random variable 
k 


u=- lIn Rk, =- tz ln Py 
i=l 


ohne procedure approximeces the density of u by 


atl 
ΓΕ 


a! 
The parameters a and 8 will be estimated from test data. 
Jhis density results from having chosen a prior density for 
Ps “hich is cuestionable on επ τοπ that It is not 
normalizable (see prameterization of the prior density, 
Ref. 1) and leads to a posterior which is also not normaliz- 
able. The choice of priors causes difficulty in estimating 
the parameters of $(u) when no failures occur on any of the 
components, and its effects will be investigated later in 
this study. However, since this is an approximate method, 
the development ean proceed from the assumption that u does 
in fact possess the above density and that estimates for a 
ana p- can be determined. 


If a new random variable v is defined where 


v = 2Bu , 





then v is distributed "chi square" with 2(a+1) degrees of 
freedom. Then the lower 100(1-y)% confidence limit, 


L(y)? can be found as follows: 


2 _ 
Ele ην. Jc 


ου 
P[u < Hu =1-y 


E X = 
P[e^" » exp(- > ey] = 1 = ¥ 


X 
= 2(a+1) 15 = = 
P[R, > exp < JU] ji Y 


Prom the probability statement above, 


*2(at1) ,1-y) 


Rs,L(y) m ri 


us che desired approximate lower confidence limit. The 
A 


e: s,L(y) 
well yield values sufficiently accurate for the reliability 


Problem is ve find an- estimate, ROI πῃ which 


manager's purposes. Bram's method specifies estimates 


sand 8, Which are computed from the test data, and substi- 


tuted into the above expression, to obtain 


^ 


g 

X 
£ E 2 (atl). l- 
De) sap EE EE 


2p 


in the following section Bram's computation procedure tor 


a and 8 is described. 





2. Description ol CNR Computation Procedure 


In the following, Bram's procedure for computing 


A 


R 
s,L(y) 
modifications to the original procedure will be referred to 


, will be referred to as method A, and the author's 


as methods B and C. 
ο τ ΤῊ ΕΡΠΕΡΘΡΕΕ a Lee Sing has been 


done, consider the k system components to be arranged as 


Momlows: 1, ο...» K > Ki t1l,..-, k, where components 
I... kK, are those whieh experience no failures, and 
kj tl, me ke IO SACATE pertence οπε ο more 


fallures. Let n; be the number of tests on component i and 


Sí be the number of suecesses in the nz; werde. πετ 


^ 


R by method A proceed as follows: 


s, L(y) 
^ k ni i 
1=k, +1 ΠῚ 
7 k ni-l 1 
Va = 2 E πο πα 
1=k. +1 J=S; J 


=> ^ 

~ Mp - A 
= — - 1 and 8 = =— =, and 
VA VA 
2. 

= 2(atl1) l- 
R = = _ENATL/JATY 
zo AP mm 


A A 


Μι and VA are estimates of the mean and variance of u under 


method A. In cases where (atl) is non integer, interpolation 


is to be used. 





3. Shortcomings oA Merode 
It should be noted that the double sums do nort 


account for components which experience no failures in 
testing, and if none of the system's components fails, a 
and 8 are not defined: under these circumstances the pro- 
eeäure can not be used as it stands. Herein lies the major 
obstacle to application of the procedure to highly reliable 
system testing programs where it is quite possible that no 
som lures will oecur. In testing the accuracy of method A, 
Mecnever no failures occur, Re L(y) fs Seu Caual to unity 
by the author's choice, since Bram makes no allowance for 
ps possibility. 
Secondly, as E is defined, it is possible that 

B), the estimate of the degrees of freedom of the chi 
square random variable can be less than one. Since a chi 
Sabre variate must have at least one degree of freedom, 
seme provision must be made to account for this inconsist-— 
ency. For computation purposes in testing the original 
Procedure of method A and the modifications, whenever DIOS 
less than one, the degrees of freedom are set equal to 
ο ον the author's choice. For all Mraetlonel values ot 
ET greater than one, linear interpolation between the 
tabulated integer degrees of freedom are used, as specified 
in the original procedure. 
B.v.EIROF"MODTETCALEFON ΤΟ ΠΟΤΟ ΕΠΕΣΕ: 

METHOD B 

The only way that the true lower confidence limit πη, 


can be unity is to have no failures on an infinite number of 





tests; this would be impossible to demonstrate. In 
searching for a more realistic value for R. EC when no 
2 


failures occur, one might be led to believe that R. He) 
2 


ould be close To but not equal to one. Due to its 
discrete character, the procedure of method A will compute 


Sne value Ol R ο αυ οἱ το Ισ ches will 


SY 
happen when one failure occurs on the component with the 


greatest number of tests. An approximation of a more 


Zreurate estimate ort R when ai lures oceur,.can De 


s,L(y) 


eor ained by using one half the original estimates MA and E 


where one failure occurs on the component with the most 
mests. "This has the effect of considering a partial failure 
on the component with the most tests and tends to smooth the 


Hu ccprete distribution of values of R. noo near unity. 
3 


In summary computar rons “under method B proceed as 


follows: 
Mp = Ma 
A > DR Ki eos and 
Vp = VA 
M. E uem eee 
N ax - 
LIS ΚΙ = k, 
Vp E ; 2 
2(N - 1) 
max 
ος lis the number of tests on the component with the 


ereatest number Ol Tests. 


EQ 





. We 
= — = l 3 

M: 
M 
B. = ME ; and 

B 

^ ΠΠ» 
R = = --------------}---------- 


If ac) < 1.0, then set ΕΟ = 1,0. 


COS E SOND MODIFICATION TO THE COMPUTATION PROCEDURE: 
NETRNOBZE 


intan eifort to refine method B so that it might be 
Meetul under conditions of very high component reliability 
and small amounts of testing, a second modification is 
presented. Method C of computing M and V "Sen ου επ ο 
μεις smooth the distribution of πα and has the 
elect of adding a partial failure to each component which 
Experiences no failure during testing. Nor method C compu= 


Deben proceeds as follows: 


Mo B T XM A Ma 
ste : ky (n; =D) 

Vo = ? > > 5 + Va 
muc κ (n, - 1) 


al 





. od 

a = απ: - 1 S, 
M 

B = L „and 
ve 


ο: 
^ X 
E Z 2(a+1),1-y 
Bo GQ exp[ żę ] 


Again, if 2(atl) < 1.0, set 2(atl) = 1.0. 


From these computations it is seen that if every 
ponen experiences at least one failure, i.e. Ky = 0, 
Bien method C reduces to method B. On the other hand, if a 
s scem consists Oi say lorty components, and there is 
wa ced testing relative to the component unreliability or 
"By ten of the components, one might feel that some adjust- 
anc shouid be made vo the overall estimate ΠΡ to 
"oROUME for the lack of testing on those ten components; 
mac ls the motivation for this second modification. 
Furthermore, any method of computing RS Ly) which yields 
accurate results with less testing than another method will 


be more desirable economically. 


12 





III. SIMULATION PROCEDURE 


The purpose of the computer simulation in this study is 
to demonstrate the accuracy of the procedures described in 
section II. The simulation considers the system of k com- 
ponents of Figure 1, where the component reliabilities and 
hence Ro are assumed to be known. For this system tests are 
simulated by the Monte Carlo technique, generating failure 
data which is used to compute R (x) by each of the three 
methods A, B, and C. By replicating the procedure 1000 
cimes, 1000 values of S are generated which are then 
arranged in ascending order. If the method of computing 
Ro Ly) is accurate, then 100(1-y)% of the time the true 
system reliability, Ros willbe greater than or equal to 


^ 


R Therefore the Oee percentile point of the 


ERU Y) 


1000 ordered values of R should be equal to or 


SETS m 
very close to the value of He if the method is accurate. 
Hom example, if y = .10 then the a percentile point or 


goo*h 


ordered value of R should BDEFELOSE=WO"M s IC 1S 
s,L(y) S 

kas difference, ie - M ul» that is the primary measure of 

deeuracy of the method of estimation. Anóther measure of 

tne accuracy is the true level of confidence. The true 

fevel οἱ conlidence sis found by determining the percentage 

of the values of R that are less than or equal to R.. 
s,L(y) S 


If the method is accurate the true level of confidence will 


be very close to 100(1-y)4. 


13 





One of the main ο ης ει"... το το determine 
what minimum amount of testing is necessary to insure that 
the method will provide accurate results. This minimum 
amount of testing will be different for each system and will 
be dependent on the number of components and their reliabil- 
ies. ος ταις reason che quantity 


I MR 
= 


sssused as a measure οἱ the amount of testing relative to 
Ene system reliability. DOW Values or ii occur when combi- 
nations of high reliability and small numbers of tests 
Soeur, and TT increases directly with the number of tests 
per component and inversely with component reliability. 
Intuitively one would feel that as TT decreases the accuracy 
of the computation procedure will decrease since fewer 
failures will οσους amd less intormation will be obeyained. 
Mer >ourpose oí the simulation 15 to determine for what 


poc ues ol TT the various methods meet desired accuracy goals. 


^Borsting, Jack Re, and Weeds, Ws. Max, Aallernogzrer 
Computing Lower Confidence Limits on System Reliability Using 
Component Mailuve Data With Unequal Sample Sizes, Naval Posuv- 
pradUave School, Monteres, Tali orna, June yoo. 
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IV. RESULTS AND CONCLUSIONS 


The analysis of accuracy results are shown in Tables I 
and II. The cases considered are grouped according to the 
number of components, system reliability, and value of TT. 
The component reliabilities, P; 'S, are held constant in 
some cases while the number of tests per component, ης 5 
are varied, to yield a range of IT values. In other cases 
the n,'s are fixed and the p,'s varied. Twenty-three cases 
of systems with reliabilities ranging from approximately 
.87 to .95 and consisting of 10, 20, and 40 components are 
considered. 

As expected the tendency of all methods to increase in 
accuracy as TT increases is substantiated. In addition, the 
tendency of increased accuracy from methods A, to B, to C is 
also substantiated. Cases el, eż, and 23 show early That 
MOR Ll =" 10.0 the- accuracy of tche three methods iis essen- 
tially the same for all three methods of computation, SERCE 
with this relatively high amount of testing the methods 
become identical. These three cases also show that as the 
umuber of SYSLTEM components echanges, air R. and TIT are theld 
constant, the accuracy Of the three methods remains essen- 
tially unchanged. 

IG is up to the user to determine what accuracy 15 
acceptable when employing any procedure to compute Rs ny 
bor illustrative αι σας αι ο «οἱ σας IR, τ᾽ Ary! <02 


to be acceptable accuracy, then for a 40 component system 





with an ονεπε ιν ΤΙ ο! 5εῃτο;πετειν. 90, the 
testing program should be such that TT = 6.50 is a minimum 
sna Ti > O UNO Uta perdes irable cl decreases below 
6.50 there is a marked deterioration in accuracy of all 


three methods as measured by both IR, - A and the true 


i-.| 
level of confidence versus the desired level of confidence. 
πο υπο Κεν kaelor Lo eonsider in using any of these methods 
is that each is sensitive to the individual component test 
sample size, n;. R n is quire small, say less than 10, 
του any component regardless of TT, a failure on one of 
those N; testami endo na reta ramas» roportlonate effect 


^ 


on R Note that in cases 6 through 10 accuracy proves 


PE O 
eo be not as good as in cases 1 through 5 for k = 20 and 
corresponding values of TT. This is because the n; values 
are generally lower for cases 6 through 10 and in some 
cases n, ure AO E 

The results show little difference in accuracy between 
"he 507 (y = .20) anar 90% (y = 9D confidemee levels among 
ο. veros cases  aridy methods. μερος πο general tendency = 
Moche accuracy to be better at either level although one 
might expect that accuracy at the 80% confidence level would 
be better than at the 90% level. For example in case 14A 
ume 6.55) aeelracy is better iL ithe 907 level. but in 
cases 13A (TT = 4.05) and 15A (TT = 9.10) accuracy is 
better at the 80% level. 


These methods are approximations. No analytical justi- 


{fication is given Tor the moditicaltrions Sitececvcaa,) “lira on 
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has been the guiding factor in development of the methods 
and the accuracy tests which are based on sound analytical 
techniques are the basis of acceptance or rejection of the 
method as a useful tool. Since systems vary widely in 
Beir composition, 15 15 not possible to cover them all 
with a set of specific rules as to when it would be appro- 
priate to use one of the methods for computing RS LG) 
However, [rom these results two general rules follow: 
l. For systems of ten to forty independent components 
TT greater than 10.0 should yield accuracies of 
p Ay y! "ow eprovided that, 
e. no component is tested less than 10 times, i.e. 
n, 2 πο δι αἱ Components: 
lf these two rules are followed it can also be concluded 
that method B should be employed since there should be no 
appreciable difference in the accuracies of methods A, B, 
eme c, and B 15 easier to compute than ©. Also B does not 
Sutter from the possibility, remote as it would be if TT 


bene preaver than 10.0, of yielding R = 1.0 as would 


s,L(y) 
method A. Any system under consideration can be tested using 
Borne the cemplter Simulation procedure. end as TI decreases 


ο πο ο ο. either because ol economic or time constraints 


in the testing program, this would be recommended. 


1 
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